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Abstract 

We present a derivation of the Jarzynski identity and the Crooks fluctuation theorem for systems 
governed by deterministic dynamics that conserves the canonical distribution such as Hamiltonian 
dynamics, Nose-Hoover dynamics, Nose-Hoover chains and Gaussian isokinetic dynamics. The 
proof is based on a relation between the heat absorbed by the system during the non-equilibrium 
process and the Jacobian of the phase flow generated by the dynamics. 
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I. INTRODUCTION 



During the past decade our understanding of the thermodynamics of non-equilibrium 
systems was considerably extended. Two relations have been derived which are valid for 
systems arbitrarily far away from equilibrium: a family of relations which are collectively 
called the fluctuation theorems^^ and Jarzynski's non-equilibrium work theorem 4 ". The 
latter theorem relates the equilibrium free energy difference AF to the statistics of work W 
carried out on a system during a non-equilibrium transformation: 

^r W = e - l 3AF_ (1) 

Here the overbar indicates an average over many realizations of the transformation process 
which is driven by switching an external parameter from an initial to a final value. The 
maximum work theorem, which states that the average work performed on the system during 
such a transformation is bounded from below by the free energy difference, i.e. W > 
AF, is a direct consequence of the Jarzynski relation. Besides providing new insight into 
the statistical mechanics of non-equilibrium processes, the Jarzynski identity has also been 
applied to extract equilibrium free energy differences from computer simulation o 5 i 6 i 7 i 8 i 9 and 
experiment o 10 ! 11 ! 12 . In particular, Liphardt et a/.— have determined the free energy required 
to unfold a single RNA chain from non-equilibrium work measurements and Douarche et 
aZ.— have verified the Jarzynski equality for a mechanical oscillator that is driven out of 
equilibrium by an external force. Another experimental test of the Jarzynski equality was 
provided by Wang et alM> who considered a colloidal particle pulled through liquid water 
by an optical trap 1 ^. 

Jarzynski's theorem has been derived by various means. While the original proof 4 applies 
to systems evolving deterministically with and without coupling to a heat bath, in subse- 
quent work 5 the proof was generalized to stochastic systems governed by a master equation. 
The latter approach comprised systems evolving under Hamiltonian dynamics, Langevin dy- 
namics, isothermal dynamics and Monte Carlo dynamics. Alternative proofs for Markovian 
stochastic dynamics that satisfies detailed balance were given by Crooks^ 4 - and later by Lech- 
ner et aZA Another elegant derivation of the non-equilibrium work relation based on the 
Feynman-Kac theorem is due to Hummer and Szabo^ 5 -, who also discussed how one can re- 
construct free energies from non-equilibrium single-molecule pulling experiments. Crooks^ 
also derived a generalized version of a transient fluctuation theorem^ - in the following called 
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the Crooks fluctuation theorem - for Markovian stochastic dynamics that is microscopically 
reversible. He showed in subsequent work^ that the Crooks fluctuation theorem and the 
Jarzynski equality can be regarded as special cases of a single theorem that follows if the 
system is microscopically reversible. This condition holds for Markovian dynamics that pre- 
serves the equilibrium distribution if left unperturbed^. Jarzynski^ and Evans^ derived 
the Crooks fluctuation theorem also for deterministic, thermostatted systems. The transient 
fluctuation theorems^ and Jarzynski's non-equilibrium work relation^ are closely related, as 
highlighted in a recent paper—. 

In this paper we present an alternative proof of the Jarzynski identity under rather 
general assumptions: we consider a system evolving according to deterministic equations of 
motion that conserve the canonical distribution. The system, which is initially equilibrated 
at a given temperature, can either be decoupled from the heat bath during the switching 
process or remains coupled to the heat bath. In the latter case the influence of the heat 
bath is described by introducing one or more variables in an extended phase space and 
the time evolution of the system is non-Hamiltonian with equations of motion that do not 
conserve phase space volume. In contrast to prior derivations, we highlight in our proof the 
relation between the change in the phase space volume and the heat absorbed by the system 
during the non-equilibrium process. We show that this relation is strictly valid for systems 
that conserve the canonical distribution when the external control parameter is held fixed. 
Various dynamical systems obey the condition mentioned above, i.e. they leave the canonical 
distribution invariant under the time evolution: this is the case for Nose-Hoover dynamics, 
Nose-Hoover chains, Gaussian isokinetic dynamics and Hamiltonian dynamics and the proof 
presented here is valid for all these systems. A recent derivation of the Jarzynski identity 
by Cuendet^ can be regarded as a special case of our proof. 

The paper is organized as follows. The proof of the Jarzynski identity is the subject of 
section II. In section III we derive the Crooks fluctuation theorem using the same formalism. 
In section IV we discuss a few examples of dynamical systems for which the proof is valid. 

II. JARZYNSKI'S THEOREM 

Consider a classical system with Hamiltonian H(x, A) depending on the internal variables 
x (such as the positions and momenta of some particles in a box or the magnetic moments 
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of a spin system) and an external parameter A (such as the volume of the box confining the 
particles or an external magnetic field applied to the spin system). For a given value of the 
external parameter A the canonical partition function is given by 

Z x = Jdx e -/»*M), (2) 

where (3 = l/Zc^T, T is the temperature and k B the Boltzmann constant. The Helmholtz 
free energy of the system is then given by 

F x = -k B T In Z x . (3) 

Here we have neglected the prefactor of the partition function which is irrelevant for the 
present discussion. 

We now consider a process where the external parameter A is switched in a finite amount 
of time r from some initial value A^ to some final value X B starting from a system that 
is initially equilibrated with a heat bath of temperature T. The time dependence of A, 
{A(i),0 < t < t}, is completely arbitrary and in general the system will be driven out of 
equilibrium during the process. For a given realization of the process the time evolution of 
the system is given by the trajectory {x(t),0 < t < r} that can be either deterministic or 
stochastic and determines the amount of work W that is performed on the system during 
that realization. We repeat this process infinitely many times where the external parameter 
is always varied in the same manner and consider the ensemble of such non-equilibrium 
processes. Jarzynski has shown that the average of the work exponential e~@ w in the en- 
semble of non-equilibrium processes can be related to the free energy difference between the 
equilibrium states corresponding to the initial and final values of the external parameter, 
AF = F B - F A , via 

Here the overbar denotes an average over all realizations of the non-equilibrium process 
starting from canonically distributed initial conditions. Equation (j3J) is Jarzynski's non- 
equilibrium work theorem. In the following, we will prove this relation for a system evolving 
deterministically in time. That is either the case for Hamiltonian dynamics where the 
system is decoupled from the heat bath during the switching process or for non-Hamiltonian 
isothermal molecular dynamics like Nose- Hoover dynamics, Nose-Hoover chains or Gaussian 
isokinetic dynamics where the system remains coupled to the heat bath. In the latter cases 
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the coupling of the heat bath is purely through the equations of motion and there is no 
interaction energy between system and bath. The deterministic evolution in the phase 
space of the system and bath is given through some equations of motion 

r = G(r,A), (5) 

where T = {x,y} includes the variables x describing the system and possibly some variables 
y describing the bath. The configuration T at time t = determines uniquely the configu- 
ration T t a time t later generating an invertible and differentiate mapping (f) t that describes 
the phase flow, 

r t = &(r„). (6) 

For simplicity we denote <p t by <fi in the case t — r. We assume that the (normalized) 
equilibrium distribution g(y) of the bath variables does not depend on the external parameter 
A and we define the function ip(y) = — A^Tlng^/). Thus, we can construct an extended 
Hamiltonian as the sum of the total energy of the system, H(x, A) and ip(y): 

n(r,X) = H(x,X)+i;(y). (7) 

The equilibrium distribution of the combined system for a particular value of A then is 



e -mv) (8) 
j dTe -m(r,x) Zx ' { } 

where we have used the fact that the distribution e _/3 ^ is normalized in the y-subspace. 
For a switch of the parameter A from A^ to A# the free energy difference AF = Fb — Fa is 
given by 

6 -/3af = Zb = i r dXre -m^ B ) 
= — f dr T e-^ T ^ 

Z A J 

= — [ rfr T e" /3 [ w(rT ' As) " w{ * _1(rT),AA) ]e~ /3W( ^ 1(rT) ' AA) , (9) 
Z A J 

where in the first step we have switched from the Hamiltonian of the subsystem to the 
extended Hamiltonian and in the second step we have multiplied and divided the integrand 
by e _/3W ^ 1 ( r ^)' A >i). Changing the integration variables from Y T to r = _1 (r T ) yields 

e -/3AF = J_ I droe -/3[H(<t>^o)A B )-n(T ,X A )] e -l3H(r ,X A ) 



Z A 

= J_ /' droe -/3W(ro,A A ) e -' 3 [ W W r o).^)-W( r o^A)]-A ;s Tln^ ^ 
Za J 



where we have introduced the Jacobian 
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of the mapping which is also called the phase 
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space compression factor. If we define a 'work function' W fr 1 ^ 21 as 

= H(T T , X B ) - H(T , X A ) - k B T In 
then Eq. (fTU|) can be rewritten as 

T A ! AT " e 



(11) 



-/3AF 



-/3W(r o ,A A ) e -/3H/ 



-pw* 



(12) 



where the overbar denotes an average over the distribution of initial conditions, i.e. a 
canonical distribution in the x-subspace, and the distribution e~^ Vo > in the |/-subspace. 
Equation ()12j) looks already quite similar to the Jarzynski identity (j2J), but what remains 
is to show that is indeed equal to the work W. The last term of the work function 
is the Jacobian determinant, while the other terms describe the change of the extended 
Hamiltonian along the trajectory starting in IV Using Def. (j2J) the work function W$ can 
be written as: 



AH + ^j(y T ) - ^j(y ) - k B T In 



dT Ci 



where 



AH = H(x T , X B ) - H{x , X A ) = Q + W 



(13) 



(14) 



is the change of the total energy of the subsystem during the switching process. In the last 
part of Eq. (JT3J) we have indicated that the energy H(x, X) can change due to two different 
reasons. One contribution arises from changes in x: 



Q 



dtV x H(x(t),X{t)) -x{t). 



(15) 



Q is the heat transferred from the heat bath to the system during the switching process. 
The other contribution originates from the change in A: 

dH(x(t),X(t)) 



W 



dt- 



dX 



-X(t). 



W is the work performed on the system by changing the external parameter. 



In the following we will show that if the distribution p(x, y) = e 
stationary solution of the Liouville equation 

dp 



-P[H(x,X)+f(y)] 



(16) 



jZ\ is a 



dt 



+ V r • (pT) = 



(17) 



for fixed A, then the work function equals the physical work W and thus Jarzynski's 
theorem is valid. 

If a phase space density p is a stationary solution of the continuity equation (fT7J). (i.e., 



|f =0), it must obey V r • (pt) = 0. In the case of p = e -/J(ff(*.W(i/)) /z x this reduces to 



T • 



(18) 



or 



V X H ■ x + Vytp ■ y - k B TV r ■ T = 0. 

Using Euler's expansion formula 22 for the time derivative of the Jacobian, 

d 



(19) 



V r -r = -ln 

at 



we finally obtain 



«9r 



d 



(20) 



V X H ■ x + Vytp ■ y - ksT— In 



«9r 



0. 



(21) 



The first term of the above equation is just the time derivative of the heat The second 
term is the rate of change of the function tf)(y): 

dip 



dt 



Integrating Eq. ()21j) from to r yields 



v v V(s/(*)H(t). 



(22) 



Q + ^{Vr) - i>{yo) - k B T\n 



dT 



0. 



(23) 



which expresses the fact that the heat transfer to the extended system, J T dfWr'H • f (i), 
exactly cancels the term including the phase space compression factor. Inserting this result 
into Eq. (JT3J) we obtain W = W^. With Eq. (|T2*|) this completes the proof of Jarzynski's 
theorem: 

(24) 



e -/3AF = e -/3W = e -f3W. 



We stress, that the physical work (|16|) depends only on the trajectory of the subsystem, 
however in Eq. (J24j) we have to average the work exponential e~@ w over all degrees of 
freedom of the extended system, since the time evolution of the subsystem depends on the 
configuration of the extended system at t — 0. 



III. CROOKS FLUCTUATION THEOREM 



With some additional assumptions the formalism presented in Sec. |H] can also be used 
to derive the Crooks fluctuation theore m 16 ! 19 for dynamics conserving the canonical distri- 
bution. The Crooks theorem relates the probability that for the forward process the work 
W takes a value C to the probability that along the reverse process it takes a value — C. 
To derive this expression we note that for each forward path A(t)), < t < r} we 

have a reverse path {(T t (t — t), A T (r — t)),0 < t < r} where the superscript T indicates 
that quantities that are odd under time reversal (such as momenta) have changed their sign. 
The work, heat, and energy difference along the reverse path are defined as above for the 
forward direction and take the negative of the respective forward values. 

We assume in the following that the extended Hamiltonian 7i is invariant under time 
reversal and that both the forward and the reverse path start from equilibrium distributions, 
i.e. p A (T ) = e^e-ZJHxCro) and = e pF B e -pH B {^) _ Then 

P F (W = C) _ 0AF J dT e-^ r ^5(W F - C) 



P R (W = -C) 



JdTT e -W( r ?> x B)5(W R + C)' 



(25) 



dTl 
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Since the Jacobian of the time reversal mapping is unity, i.e. 
Hamiltonian is invariant under time reversal we obtain 

P F (W = C) _ 0AF JdT o e-^ r ^S(W F -C) 



1, and the extended 



Pr(W 
Inserting the relation 



-c) 



JdT T e-P H ^^B)5(w R + C)' 



(26) 



H{T T , X B ) = H{x T , X B ) + ^{y T ) = H{x , X A ) + Q + W F + ^{y T ) 



H(xq, X a ) + k B T In 



dT 

H(T ,X A ) + W F + k B T\n 



into Eq. yields 

P F (W = C) 



-PAF 



JdT e^ To ^6(W F -C) 



OTV 



5(W F - C) 



(27) 



(28) 



Pr(W = -C) j'dr T e-/ 3W (^ 1 ( r -)' A ^)e-/ 3iy ^ 

where we have used the fact that the work is odd under time reversal, i.e. Wr = —W F . 
Changing the integration variables in the denominator from T T to Tq = _1 (r r ) one obtains 



p F (W = C) 
P R (W = -C) 



-PAF 



JdT e-^ r °' x ^S(W F -C) 
/dr e-^( r o^)e-^5(H/ F - C) 



e -/3AF e /3C 



JdT e-^ r °' x ^S(W F -C) 
JdT Q e-^ n ( r o^A)S(W F -C) 



(29) 



Thus, the Crooks fluctuation theorem is valid provided the dynamics conserves the extended 
canonical distribution and the extended Hamiltonian is invariant under time reversal. 

IV. DISCUSSION 

We have shown that the Jarzynski identity is valid for deterministic dynamics that con- 
serves an extended canonical distribution of the form of Eq. (JHJ) . Let us now consider a few 
examples of such dynamical systems. 

A. Hamiltonian dynamics 

For Hamiltonian dynamics the proof of Section II simplifies considerably since we do not 
need to consider the ^/-subspace. Furthermore, the phase space volume is conserved, i.e. 
0^ = 1, and no heat Q is absorbed by the isolated system. Thus the work function 
trivially equals the physical work W and the Jarzynski relation holds. 

One can also consider the case when the system of interest and the heat bath form a 
large Hamiltonian system and the coupling between them is weak. In this case, ip{y) is just 
the Hamiltonian of the heat bath and the phase space compression factor in Eq. is 
identically zero. So, Eq. states that the heat Q absorbed by the system is just equal to 
the negative change of the internal energy of the heat bath, Q = — {ip(y T ) — ip(yo)}. 

B. Nose-Hoover dynamics and Nose-Hoover chain dynamics 

In the case of Nose-Hoover dynamic s 23 ' 24 the heat bath is represented by an additional 
degree of freedom ( and effective mass Q and the equilibrium distribution function is the 
extended canonical distribution 24 



where H is the Hamiltonian of the system and (q,p) are the positions and momenta of 
the particles. Thus relation (jHJ) is fulfilled if one identifies x with (p, q) , y with ( and sets 



p{p, Q, C) oc e 



l3(H{p,q;X)+e/2Q) 



(30) 
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ip{y) = C 2 /2Q and the Jarzynski identity holds. In order to enhance ergodic sampling, the 
Nose-Hoover approach is often augmented with chains of Nose-Hoover thermostats^. The 
corresponding equations of motion preserve the phase space distribution 

pb,q,Si) oc e-^^HE^AQO. (31) 

that has the form of Eq. (jHJ) which is required for the validity of the Jarzynski identity and 
the Crooks fluctuation theorem. 



C. Gaussian-isokinetic dynamics 



In contrast to the Nose-Hoover dynamics that fixes the temperature of the system the 
Gaussian isokinetic equations fix the kinetic energy 26,27 . In the thermodynamic limit the 
corresponding equilibrium distribution 2 ^ is the so called isokinetic distribution 

, n e-M**) S (K(p) - go) 
PlP ' g ' U fdpdqe-P v ^ x )5{K{p)-K o y 1 ' 

This distribution is canonical in configuration space and microcanonical in momentum space. 

If the kinetic energy of the system is independent of the external parameter, i.e. 

H(x;\) = V(q;X) + K(p), (33) 

the work performed on the system can be rewritten as 

JO OA JO OA 

Thus 

ah = r dt 9H{x{ *\> m \(t) + r dtv x H( X (t), aw) ■ m 

Jo OA Jo 

= AV= T dt dV{q{ ^ m) A(t) + [ T dtV q V(q(t), A(t)) ■ q(t) (35) 

Jo OA Jo 

implying that the heat transfer to the system is given by 

Q= [ T dtV x H(x(t), X(t)) ■ x(t) = r dtV q V(q(t), X(t)) ■ q(t). (36) 
Jo Jo 

The equilibrium distribution takes the form of Eq. (jH} if one identifies x = q, y = p, 

ip{y) = 5{K{p) — K ) and replaces H(x; A) by V(q; A). Since the definition of work and heat 

remain valid if one replaces the Hamiltonian function by the potential energy, the Jarzynski 

theorem and the Crooks fluctuation theorem are valid for Gaussian isokinetic dynamics. 
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V. CONCLUSION 



We have presented a proof of the Jarzynski theorem and the Crooks fluctuation theorem. 
This proof is valid for systems evolving under deterministic equations of motion that conserve 
an extended factorizing canonical distribution of the form of Eq.(JSJ). Several dynamical 
systems that meet the latter condition have been discussed. The crucial part of the derivation 
is a relation between the heat transferred to the extended system during the switching process 
and the phase space compression factor of the dynamics which was established using Euler's 
expansion formula. 
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